Workbook Introduction

The purpose of this wookbook is to analyze the data generated from the first portion of the project. I've removed a lot of code due to it's proprietary nature, but have left a majority of visuals to illustrate at a high level what that code does. The structure of this workbook is to illustrate the following:

1) Setup of the h2o cluster

2) Ideal model evaluation for product completion

3) Individual parameter exploratory investigation

Initialize Cluster

I removed a lot of proprietary code, but the ideal is that a cluster has to be initialized with h2o with certain parameters. The api isn't very easy to use, so my team wrote an entire process to submit the necessary linux commands, grab the ip address, and connect to something initialized from the workbook. H2O allows for users to utilize up to a terabyte of cluster memory to process large datasets, with the only other limitation being constrained to a strict api preventing a lot of common operations from easily being performed.

In [37]:
dbName2 = 'mcbethk'
tableName2 = 'skybolt_hd_instby'

dat2 = importer2.Import(db_name=dbName2, table_name=tableName2, column_types=column_types)

Getting Numeric Columns

Importing Data

2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
2019-12-16 20:06:36,594[DEBUG]: Hive Importer start importing...
DEBUG:skutil.data_import.data_import:Hive Importer start importing...

Parse progress: |█████████████████████████████████████████████████████████| 100%

2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
2019-12-16 20:07:34,960[DEBUG]: Hive Import success
DEBUG:skutil.data_import.data_import:Hive Import success

Model Evaluation

The purpose of this project was to compare the new parameters with the old. I managed to run a simple test by running the workflow on a single sub table. What's fascinating is that this simple table had a better train and validation auc than the original model. This indicates that this is better than our original methodolgy, without including any of the other 28 missing tables.

The most important metrics from this section are the model auc and the grading and crr plots. Those are the bottom two plots (blue bars and red lines). Those essentially measure the spread in the final score, comparing good to bad. This model yielded a 2.5 times spread, which is very comparable to what was originally found. These plots look much more stable than the model fitted on the other model, indicating that the parameters found in this section were much more stable than those found in the original method of aggregation.

There are a lot things occurring in this section. Essentially, the data is being split via time cuts into three sections. Then, each parameter is fit via a generalized linear model onto the target (pass or fail), utilizing the first two time bins. This step is repeated again on the last time bins. Finally the model is trained on the first two time bins and validated against the final time bin, for a final model that has been verified through multiple cuts of time (for generalizability). This model technically overfits, which is to be expected for data this imbalanced. This is not necessarily the worst result, as this target variable hasn't even developed, indicating that auc might improve over time as those drives have more time in the field such that they can fail.

In [52]:
%matplotlib inline
pd.options.display.max_rows = 999
testDat = mergedDat[mergedDat['prdct_product_format_capacity'] == 1800]
na_dat = testDat.isna()
na_percent = (na_dat.sum(return_frame=True)/na_dat.shape[0])
na_pandas = na_percent.as_data_frame().transpose().sort_values(by=0, ascending=False)
parameters = [x[5:-1] for x in na_pandas.loc[(na_pandas[0] <= 0.00001) & (na_pandas[0] >= 0.000007)].index.values.tolist()]
#run model via proprietary code

Transforming Data
Imputing all columns in batch
Generating Sets
5 bins processed
15 bins processed
(317864, 611) (723350, 611) (1041214, 611) (1132874, 611)
Train Target Labels:
target Count
FAIL 315
PASS 317549
 
 Validation Target Labels:
target Count
FAIL 337
PASS 723013
 
 Full Train Target Labels:
target Count
FAIL 635
PASS 1.04058e+06
 
 Test Target Labels:
target Count
FAIL 377
PASS 1.1325e+06
 
Training Ship Date Max: 2018-06-07 00:00:00
Validation Ship Date Max: 2018-12-19 00:00:00
Test Ship Date Max: 2019-09-11 00:00:00
making directory: /mnt/notebooks/mcbethk/results/c2fi/tenMonths/skybolt/12_16_2019_16/fin2
2019-09-11 00:00:00
2019-05-14 00:00:00
Running key column selection in auc mode

/mnt/conda/lib/python3.6/site-packages/h2o/job.py:69: UserWarning:

Reached maximum number of iterations 50!


['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2']
Selecting test columns
Running test column selection in auc mode
['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2']
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6409356570134224
Validation AUC
0.5428672521717572
Model Details
=============
H2OGeneralizedLinearEstimator :  Generalized Linear Modeling
Model Key:  GLM_model_python_1576526662757_6716


ModelMetricsBinomialGLM: glm
** Reported on train data. **

MSE: 0.0006171600894068796
RMSE: 0.02484270696616775
LogLoss: 0.005134640008859406
Null degrees of freedom: 1041213
Residual degrees of freedom: 1041200
Null deviance: 10670.499238872206
Residual deviance: 10692.518128315332
AIC: 10720.518128315332
AUC: 0.6409356570134224
pr_auc: 0.9996002576710424
Gini: 0.28187131402684473
Confusion Matrix (Act/Pred) for max f1 @ threshold = 9.497205468409194e-05:
FAIL PASS Error Rate
FAIL 0.0 635.0 1.0 (635.0/635.0)
PASS 0.0 1040579.0 0.0 (0.0/1040579.0)
Total 0.0 1041214.0 0.0006 (635.0/1041214.0)
Maximum Metrics: Maximum metrics at their respective thresholds
metric threshold value idx
max f1 0.0000950 0.9996950 399.0
max f2 0.0000950 0.9998780 399.0
max f0point5 0.0000950 0.9995120 399.0
max accuracy 0.0000950 0.9993901 399.0
max precision 0.9998915 1.0 0.0
max recall 0.0000950 1.0 399.0
max specificity 0.9998915 1.0 0.0
max absolute_mcc 0.9994409 0.0110937 68.0
max min_per_class_accuracy 0.9993424 0.5968504 85.0
max mean_per_class_accuracy 0.9994409 0.6120089 68.0
Gains/Lift Table: Avg response rate: 99.94 %, avg score: 99.93 %
group cumulative_data_fraction lower_threshold lift cumulative_lift response_rate score cumulative_response_rate cumulative_score capture_rate cumulative_capture_rate gain cumulative_gain
1 0.0100008 0.9997365 1.0004181 1.0004181 0.9998079 0.9997579 0.9998079 0.9997579 0.0100050 0.0100050 0.0418052 0.0418052
2 0.0200007 0.9997164 1.0003219 1.0003700 0.9997119 0.9997256 0.9997599 0.9997418 0.0100031 0.0200081 0.0321932 0.0369995
3 0.0300006 0.9997029 1.0006102 1.0004501 1.0 0.9997093 0.9998399 0.9997310 0.0100060 0.0300141 0.0610237 0.0450073
4 0.0400004 0.9996918 1.0006102 1.0004901 1.0 0.9996972 0.9998799 0.9997225 0.0100060 0.0400200 0.0610237 0.0490113
5 0.0500003 0.9996821 1.0005141 1.0004949 0.9999040 0.9996869 0.9998848 0.9997154 0.0100050 0.0500250 0.0514136 0.0494917
6 0.1000006 0.9996452 1.0004180 1.0004565 0.9998079 0.9996627 0.9998463 0.9996890 0.0500212 0.1000462 0.0418038 0.0456478
7 0.1499999 0.9996155 1.0003796 1.0004308 0.9997695 0.9996300 0.9998207 0.9996694 0.0500183 0.1500645 0.0379593 0.0430850
8 0.2000002 0.9995882 1.0003604 1.0004132 0.9997503 0.9996017 0.9998031 0.9996525 0.0500183 0.2000828 0.0360378 0.0413232
9 0.2999998 0.9995344 1.0002835 1.0003700 0.9996735 0.9995614 0.9997599 0.9996221 0.1000280 0.3001108 0.0283495 0.0369986
10 0.4000004 0.9994770 1.0001874 1.0003243 0.9995774 0.9995063 0.9997143 0.9995931 0.1000193 0.4001301 0.0187398 0.0324339
11 0.5 0.9994127 1.0000048 1.0002604 0.9993949 0.9994456 0.9996504 0.9995636 0.1000001 0.5001302 0.0004803 0.0260432
12 0.5999996 0.9993372 0.9998510 1.0001922 0.9992413 0.9993760 0.9995822 0.9995324 0.0999847 0.6001149 -0.0148958 0.0192200
13 0.7000002 0.9992451 0.9999183 1.0001531 0.9993085 0.9992930 0.9995431 0.9994982 0.0999924 0.7001073 -0.0081681 0.0153074
14 0.7999998 0.9991223 0.9997838 1.0001069 0.9991740 0.9991873 0.9994970 0.9994593 0.0999780 0.8000853 -0.0216229 0.0106912
15 0.8999994 0.9989128 0.9996973 1.0000614 0.9990876 0.9990303 0.9994515 0.9994116 0.0999693 0.9000547 -0.0302720 0.0061397
16 1.0 0.0000000 0.9994474 1.0 0.9988379 0.9983476 0.9993901 0.9993052 0.0999453 1.0 -0.0552570 0.0

ModelMetricsBinomialGLM: glm
** Reported on validation data. **

MSE: 0.00034056863754448717
RMSE: 0.018454501823254053
LogLoss: 0.0030656339979223033
Null degrees of freedom: 1132873
Residual degrees of freedom: 1132860
Null deviance: 6963.075770731671
Residual deviance: 6945.954099520335
AIC: 6973.954099520335
AUC: 0.5428672521717572
pr_auc: 0.9996814550027422
Gini: 0.08573450434351448
Confusion Matrix (Act/Pred) for max f1 @ threshold = 3.169559289162015e-08:
FAIL PASS Error Rate
FAIL 0.0 377.0 1.0 (377.0/377.0)
PASS 0.0 1132497.0 0.0 (0.0/1132497.0)
Total 0.0 1132874.0 0.0003 (377.0/1132874.0)
Maximum Metrics: Maximum metrics at their respective thresholds
metric threshold value idx
max f1 0.0000000 0.9998336 399.0
max f2 0.0000000 0.9999334 399.0
max f0point5 0.0000000 0.9997338 399.0
max accuracy 0.0000000 0.9996672 399.0
max precision 0.9999216 1.0 0.0
max recall 0.0000000 1.0 399.0
max specificity 0.9999216 1.0 0.0
max absolute_mcc 0.9996103 0.0028328 72.0
max min_per_class_accuracy 0.9996031 0.5305040 75.0
max mean_per_class_accuracy 0.9996103 0.5388260 72.0
Gains/Lift Table: Avg response rate: 99.97 %, avg score: 99.96 %
group cumulative_data_fraction lower_threshold lift cumulative_lift response_rate score cumulative_response_rate cumulative_score capture_rate cumulative_capture_rate gain cumulative_gain
1 0.0100002 0.9997775 1.0001563 1.0001563 0.9998235 0.9997939 0.9998235 0.9997939 0.0100018 0.0100018 0.0156296 0.0156296
2 0.0200005 0.9997637 1.0000680 1.0001121 0.9997352 0.9997699 0.9997793 0.9997819 0.0100009 0.0200027 0.0067997 0.0112147
3 0.0300007 0.9997544 1.0000680 1.0000974 0.9997352 0.9997588 0.9997646 0.9997742 0.0100009 0.0300036 0.0067997 0.0097430
4 0.0400000 0.9997472 0.9998914 1.0000459 0.9995586 0.9997506 0.9997131 0.9997683 0.0099983 0.0400019 -0.0108638 0.0045916
5 0.0500003 0.9997411 0.9998914 1.0000150 0.9995587 0.9997441 0.9996822 0.9997635 0.0099991 0.0500010 -0.0108599 0.0015013
6 0.1000005 0.9997184 1.0001210 1.0000680 0.9997882 0.9997289 0.9997352 0.9997462 0.0500063 0.1000073 0.0120973 0.0067993
7 0.1499999 0.9997015 1.0000856 1.0000739 0.9997528 0.9997096 0.9997411 0.9997340 0.0500037 0.1500110 0.0085648 0.0073878
8 0.2000002 0.9996870 1.0000680 1.0000724 0.9997352 0.9996941 0.9997396 0.9997240 0.0500037 0.2000147 0.0067993 0.0072407
9 0.2999998 0.9996612 0.9999797 1.0000415 0.9996469 0.9996739 0.9997087 0.9997073 0.0999976 0.3000123 -0.0020310 0.0041501
10 0.4000004 0.9996364 1.0000857 1.0000525 0.9997528 0.9996488 0.9997197 0.9996927 0.1000091 0.4000214 0.0085653 0.0052539
11 0.5 0.9996105 1.0000327 1.0000486 0.9996999 0.9996236 0.9997158 0.9996789 0.1000029 0.5000243 0.0032670 0.0048565
12 0.5999996 0.9995816 0.9999709 1.0000356 0.9996381 0.9995964 0.9997028 0.9996651 0.0999967 0.6000210 -0.0029140 0.0035614
13 0.7000002 0.9995463 0.9999709 1.0000264 0.9996381 0.9995647 0.9996936 0.9996508 0.0999976 0.7000186 -0.0029137 0.0026364
14 0.7999998 0.9994979 0.9999532 1.0000172 0.9996204 0.9995236 0.9996844 0.9996349 0.0999950 0.8000136 -0.0046801 0.0017219
15 0.8999995 0.9994129 0.9999885 1.0000140 0.9996557 0.9994607 0.9996812 0.9996155 0.0999985 0.9000121 -0.0011480 0.0014030
16 1.0 0.0000000 0.9998737 1.0 0.9995410 0.9991013 0.9996672 0.9995641 0.0999879 1.0 -0.0126267 0.0
Scoring History:
timestamp duration iterations negative_log_likelihood objective
2019-12-16 23:25:35 0.000 sec 0 5335.2496194 0.0051241
2019-12-16 23:25:35 0.018 sec 1 5346.2590642 0.0051353









    






/mnt/conda/lib/python3.6/site-packages/matplotlib/cbook/__init__.py:424: MatplotlibDeprecationWarning:


Passing one of 'on', 'true', 'off', 'false' as a boolean is deprecated; use an actual boolean (True/False) instead.











    

















    






[2.33630189558061, 2.3391864122247013, 37872.67552885344, 38767.53752597171, 551.4884816776367, 521.9394089353505, 508.88985598214504, 1.8424273860190703, 1.8587606716895602, 1.8320484998763165, 0.017954333431227293, 0.01721293259782801, 0.01676939613226865]
Parse progress: |█████████████████████████████████████████████████████████| 100%
Here is the intercept
-46.17264169946554
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Fluctuation Plot
Parse progress: |█████████████████████████████████████████████████████████| 100%
86400000
(118, 1)










    

















    

















    






Saving Fluctuation Graph
Thresholds
D, C, B, A for fin2: 
   Percentage     Value Grade
0       0.005  2.539424     D
1       0.300  4.699322     C
2       0.600  5.244047     B
3       1.000  9.514991     A
   Probs  exp(C1)Quantiles
0  0.005          2.539424
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05,  0.1,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,
               0.9, 0.95, 0.98, 0.99,  1.0],
             dtype='float64')










    

















    






Generating Fluctuation Plot
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05,  0.1,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,
               0.9, 0.95, 0.98, 0.99,  1.0],
             dtype='float64')










    

















    






Generating Fluctuation Plot
Generating CRR curve
glm prediction progress: |████████████████████████████████████████████████| 100%










    






/mnt/notebooks/mcbethk/functions/masterFunctions.py:623: FutureWarning:

Method .as_matrix will be removed in a future version. Use .values instead.

/mnt/notebooks/mcbethk/functions/masterFunctions.py:630: FutureWarning:

Method .as_matrix will be removed in a future version. Use .values instead.











    

















    






making directory: /mnt/notebooks/mcbethk/results/c2fi/tenMonths/skybolt/12_16_2019_16/fnc2
2019-09-11 00:00:00
2019-05-14 00:00:00
Running key column selection in auc mode
['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2']
Selecting test columns
Running test column selection in auc mode
['avg_adj_ber_log10_hd0_spc30100_fnc2', 'avg_adj_ber_log10_hd1_spc30100_fnc2', 'avg_adj_ber_log10_hd2_spc30100_fnc2', 'avg_adj_ber_log10_hd3_spc30100_fnc2', 'avg_adj_ber_log10_hd4_spc30100_fnc2', 'avg_adj_ber_log10_hd5_spc30100_fnc2', 'avg_full_mean_hd0_spc30100_fnc2', 'avg_full_mean_hd1_spc30100_fnc2', 'avg_full_mean_hd2_spc30100_fnc2', 'avg_full_mean_hd3_spc30100_fnc2', 'avg_full_mean_hd4_spc30100_fnc2', 'avg_full_mean_hd5_spc30100_fnc2', 'avg_sigma_hd0_spc30100_fnc2', 'avg_sigma_hd1_spc30100_fnc2', 'avg_sigma_hd2_spc30100_fnc2', 'avg_sigma_hd3_spc30100_fnc2', 'avg_sigma_hd4_spc30100_fnc2', 'avg_sigma_hd5_spc30100_fnc2', 'avg_num_modes_hd0_spc30100_fnc2', 'avg_num_modes_hd1_spc30100_fnc2', 'avg_num_modes_hd2_spc30100_fnc2', 'avg_num_modes_hd3_spc30100_fnc2', 'avg_num_modes_hd4_spc30100_fnc2', 'avg_num_modes_hd5_spc30100_fnc2', 'avg_sigma_loss_hd0_spc30100_fnc2', 'avg_sigma_loss_hd1_spc30100_fnc2', 'avg_sigma_loss_hd2_spc30100_fnc2', 'avg_sigma_loss_hd3_spc30100_fnc2', 'avg_sigma_loss_hd4_spc30100_fnc2', 'avg_sigma_loss_hd5_spc30100_fnc2']
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6409356570134224
Validation AUC
0.5428672521717572
Model Details
=============
H2OGeneralizedLinearEstimator :  Generalized Linear Modeling
Model Key:  GLM_model_python_1576526662757_7922


ModelMetricsBinomialGLM: glm
** Reported on train data. **

MSE: 0.0006171600894068796
RMSE: 0.02484270696616775
LogLoss: 0.005134640008859406
Null degrees of freedom: 1041213
Residual degrees of freedom: 1041200
Null deviance: 10670.499238872206
Residual deviance: 10692.518128315332
AIC: 10720.518128315332
AUC: 0.6409356570134224
pr_auc: 0.9996002576710424
Gini: 0.28187131402684473
Confusion Matrix (Act/Pred) for max f1 @ threshold = 9.497205468409194e-05: 










    








FAIL
PASS
Error
Rate


FAIL
0.0
635.0
1.0
 (635.0/635.0)


PASS
0.0
1040579.0
0.0
 (0.0/1040579.0)


Total
0.0
1041214.0
0.0006
 (635.0/1041214.0)










    






Maximum Metrics: Maximum metrics at their respective thresholds











    







metric
threshold
value
idx


max f1
0.0000950
0.9996950
399.0


max f2
0.0000950
0.9998780
399.0


max f0point5
0.0000950
0.9995120
399.0


max accuracy
0.0000950
0.9993901
399.0


max precision
0.9998915
1.0
0.0


max recall
0.0000950
1.0
399.0


max specificity
0.9998915
1.0
0.0


max absolute_mcc
0.9994409
0.0110937
68.0


max min_per_class_accuracy
0.9993424
0.5968504
85.0


max mean_per_class_accuracy
0.9994409
0.6120089
68.0










    






Gains/Lift Table: Avg response rate: 99.94 %, avg score: 99.93 %











    








group
cumulative_data_fraction
lower_threshold
lift
cumulative_lift
response_rate
score
cumulative_response_rate
cumulative_score
capture_rate
cumulative_capture_rate
gain
cumulative_gain



1
0.0100008
0.9997365
1.0004181
1.0004181
0.9998079
0.9997579
0.9998079
0.9997579
0.0100050
0.0100050
0.0418052
0.0418052



2
0.0200007
0.9997164
1.0003219
1.0003700
0.9997119
0.9997256
0.9997599
0.9997418
0.0100031
0.0200081
0.0321932
0.0369995



3
0.0300006
0.9997029
1.0006102
1.0004501
1.0
0.9997093
0.9998399
0.9997310
0.0100060
0.0300141
0.0610237
0.0450073



4
0.0400004
0.9996918
1.0006102
1.0004901
1.0
0.9996972
0.9998799
0.9997225
0.0100060
0.0400200
0.0610237
0.0490113



5
0.0500003
0.9996821
1.0005141
1.0004949
0.9999040
0.9996869
0.9998848
0.9997154
0.0100050
0.0500250
0.0514136
0.0494917



6
0.1000006
0.9996452
1.0004180
1.0004565
0.9998079
0.9996627
0.9998463
0.9996890
0.0500212
0.1000462
0.0418038
0.0456478



7
0.1499999
0.9996155
1.0003796
1.0004308
0.9997695
0.9996300
0.9998207
0.9996694
0.0500183
0.1500645
0.0379593
0.0430850



8
0.2000002
0.9995882
1.0003604
1.0004132
0.9997503
0.9996017
0.9998031
0.9996525
0.0500183
0.2000828
0.0360378
0.0413232



9
0.2999998
0.9995344
1.0002835
1.0003700
0.9996735
0.9995614
0.9997599
0.9996221
0.1000280
0.3001108
0.0283495
0.0369986



10
0.4000004
0.9994770
1.0001874
1.0003243
0.9995774
0.9995063
0.9997143
0.9995931
0.1000193
0.4001301
0.0187398
0.0324339



11
0.5
0.9994127
1.0000048
1.0002604
0.9993949
0.9994456
0.9996504
0.9995636
0.1000001
0.5001302
0.0004803
0.0260432



12
0.5999996
0.9993372
0.9998510
1.0001922
0.9992413
0.9993760
0.9995822
0.9995324
0.0999847
0.6001149
-0.0148958
0.0192200



13
0.7000002
0.9992451
0.9999183
1.0001531
0.9993085
0.9992930
0.9995431
0.9994982
0.0999924
0.7001073
-0.0081681
0.0153074



14
0.7999998
0.9991223
0.9997838
1.0001069
0.9991740
0.9991873
0.9994970
0.9994593
0.0999780
0.8000853
-0.0216229
0.0106912



15
0.8999994
0.9989128
0.9996973
1.0000614
0.9990876
0.9990303
0.9994515
0.9994116
0.0999693
0.9000547
-0.0302720
0.0061397



16
1.0
0.0000000
0.9994474
1.0
0.9988379
0.9983476
0.9993901
0.9993052
0.0999453
1.0
-0.0552570
0.0










    







ModelMetricsBinomialGLM: glm
** Reported on validation data. **

MSE: 0.00034056863754448717
RMSE: 0.018454501823254053
LogLoss: 0.0030656339979223033
Null degrees of freedom: 1132873
Residual degrees of freedom: 1132860
Null deviance: 6963.075770731671
Residual deviance: 6945.954099520335
AIC: 6973.954099520335
AUC: 0.5428672521717572
pr_auc: 0.9996814550027422
Gini: 0.08573450434351448
Confusion Matrix (Act/Pred) for max f1 @ threshold = 3.169559289162015e-08: 










    








FAIL
PASS
Error
Rate


FAIL
0.0
377.0
1.0
 (377.0/377.0)


PASS
0.0
1132497.0
0.0
 (0.0/1132497.0)


Total
0.0
1132874.0
0.0003
 (377.0/1132874.0)










    






Maximum Metrics: Maximum metrics at their respective thresholds











    







metric
threshold
value
idx


max f1
0.0000000
0.9998336
399.0


max f2
0.0000000
0.9999334
399.0


max f0point5
0.0000000
0.9997338
399.0


max accuracy
0.0000000
0.9996672
399.0


max precision
0.9999216
1.0
0.0


max recall
0.0000000
1.0
399.0


max specificity
0.9999216
1.0
0.0


max absolute_mcc
0.9996103
0.0028328
72.0


max min_per_class_accuracy
0.9996031
0.5305040
75.0


max mean_per_class_accuracy
0.9996103
0.5388260
72.0










    






Gains/Lift Table: Avg response rate: 99.97 %, avg score: 99.96 %











    








group
cumulative_data_fraction
lower_threshold
lift
cumulative_lift
response_rate
score
cumulative_response_rate
cumulative_score
capture_rate
cumulative_capture_rate
gain
cumulative_gain



1
0.0100002
0.9997775
1.0001563
1.0001563
0.9998235
0.9997939
0.9998235
0.9997939
0.0100018
0.0100018
0.0156296
0.0156296



2
0.0200005
0.9997637
1.0000680
1.0001121
0.9997352
0.9997699
0.9997793
0.9997819
0.0100009
0.0200027
0.0067997
0.0112147



3
0.0300007
0.9997544
1.0000680
1.0000974
0.9997352
0.9997588
0.9997646
0.9997742
0.0100009
0.0300036
0.0067997
0.0097430



4
0.0400000
0.9997472
0.9998914
1.0000459
0.9995586
0.9997506
0.9997131
0.9997683
0.0099983
0.0400019
-0.0108638
0.0045916



5
0.0500003
0.9997411
0.9998914
1.0000150
0.9995587
0.9997441
0.9996822
0.9997635
0.0099991
0.0500010
-0.0108599
0.0015013



6
0.1000005
0.9997184
1.0001210
1.0000680
0.9997882
0.9997289
0.9997352
0.9997462
0.0500063
0.1000073
0.0120973
0.0067993



7
0.1499999
0.9997015
1.0000856
1.0000739
0.9997528
0.9997096
0.9997411
0.9997340
0.0500037
0.1500110
0.0085648
0.0073878



8
0.2000002
0.9996870
1.0000680
1.0000724
0.9997352
0.9996941
0.9997396
0.9997240
0.0500037
0.2000147
0.0067993
0.0072407



9
0.2999998
0.9996612
0.9999797
1.0000415
0.9996469
0.9996739
0.9997087
0.9997073
0.0999976
0.3000123
-0.0020310
0.0041501



10
0.4000004
0.9996364
1.0000857
1.0000525
0.9997528
0.9996488
0.9997197
0.9996927
0.1000091
0.4000214
0.0085653
0.0052539



11
0.5
0.9996105
1.0000327
1.0000486
0.9996999
0.9996236
0.9997158
0.9996789
0.1000029
0.5000243
0.0032670
0.0048565



12
0.5999996
0.9995816
0.9999709
1.0000356
0.9996381
0.9995964
0.9997028
0.9996651
0.0999967
0.6000210
-0.0029140
0.0035614



13
0.7000002
0.9995463
0.9999709
1.0000264
0.9996381
0.9995647
0.9996936
0.9996508
0.0999976
0.7000186
-0.0029137
0.0026364



14
0.7999998
0.9994979
0.9999532
1.0000172
0.9996204
0.9995236
0.9996844
0.9996349
0.0999950
0.8000136
-0.0046801
0.0017219



15
0.8999995
0.9994129
0.9999885
1.0000140
0.9996557
0.9994607
0.9996812
0.9996155
0.0999985
0.9000121
-0.0011480
0.0014030



16
1.0
0.0000000
0.9998737
1.0
0.9995410
0.9991013
0.9996672
0.9995641
0.0999879
1.0
-0.0126267
0.0










    






Scoring History: 










    








timestamp
duration
iterations
negative_log_likelihood
objective



2019-12-16 23:51:13
 0.000 sec
0
5335.2496194
0.0051241



2019-12-16 23:51:13
 0.024 sec
1
5346.2590642
0.0051353










    















    

















    






[2.33630189558061, 2.3391864122247013, 37872.67552885344, 38767.53752597171, 551.4884816776367, 521.9394089353505, 508.88985598214504, 1.8424273860190703, 1.8587606716895602, 1.8320484998763165, 0.017954333431227293, 0.01721293259782801, 0.01676939613226865]
Parse progress: |█████████████████████████████████████████████████████████| 100%
Here is the intercept
-46.17264169946554
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Fluctuation Plot
Parse progress: |█████████████████████████████████████████████████████████| 100%
86400000
(118, 1)










    

















    

















    






Saving Fluctuation Graph
Thresholds
D, A for fnc2: 
   Percentage     Value Grade
0       0.005  2.539424     D
1       0.300  4.699322     C
2       0.600  5.244047     B
3       1.000  9.514991     A
Parse progress: |█████████████████████████████████████████████████████████| 100%
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05,  0.1,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,
               0.9, 0.95, 0.98, 0.99,  1.0],
             dtype='float64')










    

















    






Generating Fluctuation Plot
Generating Grading Plot
glm prediction progress: |████████████████████████████████████████████████| 100%
Float64Index([0.01, 0.02, 0.05,  0.1,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,
               0.9, 0.95, 0.98, 0.99,  1.0],
             dtype='float64')










    

















    






Generating Fluctuation Plot
Generating CRR curve
glm prediction progress: |████████████████████████████████████████████████| 100%










    




























Parametric Exploratory Analysis
This tool is the primary investigation tool for this project, as model evaluation is still a long way from being a true comparison between similar dataforms (despite already showing improvement from a single parameter). One of my previous concerns (and my last project) was to ensure that we were removing time for our analysis by checking removing time covariance with key parameters. That concern led to this method of evaluation, where the parameter is plotted alongside it's failure rate over the parameter span while also plotting its drift over time. For many of our previous modeling efforts.


Given that introduction, this code simply iterates through all the parameters, fits a generalized linear model to see if it could be used to find any linear separate between passers and failures, and if it meets an acceptable threshold (.52 validation auc) plots both the train and test failure vs parameter distribution plots and the paramater quantiles over time plots. The aucs for some of these individual parameters are roughly equivalent to that originally given by our starting aggregated model with over 1500 parameters.


Evaluating these plots is very difficult, but they demonstrate a fundamental issue with our data modeling techniques illustrating that new metrics are used, or the target variable is further split based into it's subcomponents for individual studying.













In [63]:



    


total = testDat.shape
parameters = [x[5:-1] for x in na_pandas.loc[(na_pandas[0] <= .8) & (na_pandas[0] >= .005)].index.values.tolist()]
#run exploratory analysis via proprietary code



    















    






skip_tracks_hd1_fnc2_spc1_aflaw_pad_18
skip_tracks_hd1_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.492267722597659
Validation AUC
0.5245076449683427










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5639470115758323
Validation AUC
0.47216205300711894
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5385723904850052
Validation AUC
0.5363519315848704










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5604258064568904
Validation AUC
0.46327119772323266
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5441779121069038
Validation AUC
0.49633466724824277
skip_tracks_hd0_fnc2_spc1_aflaw_pad_18
skip_tracks_hd0_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5344422507543232
Validation AUC
0.49436023071657864
skip_tracks_hd4_fnc2_spc1_aflaw_pad_18
skip_tracks_hd4_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5121261718278827
Validation AUC
0.49185363813220107
skip_tracks_hd5_fnc2_spc1_aflaw_pad_18
skip_tracks_hd5_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5111686318532531
Validation AUC
0.4939482159179277
skip_tracks_hd3_fnc2_spc1_aflaw_pad_18
skip_tracks_hd3_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4848033132140824
Validation AUC
0.4969182130957882
skip_tracks_hd2_fnc2_spc1_aflaw_pad_18
skip_tracks_hd2_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.498135037532849
Validation AUC
0.45705599628895793
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5243919875164663
Validation AUC
0.5399487964451507










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_18
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_18 0.5784815285581091
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4922632746304534
Validation AUC
0.5390109738525284










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd3_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd3_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5441750048991195
Validation AUC
0.49808531149689034
refined_srvo_flaw_cnt_hd0_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd0_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5639461942164753
Validation AUC
0.4721587583481831
refined_srvo_flaw_cnt_hd0_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd0_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5639461942164753
Validation AUC
0.4721587583481831
refined_srvo_flaw_cnt_hd1_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd1_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5385674626661617
Validation AUC
0.5366376437669723










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd2_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd2_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5604223278121434
Validation AUC
0.4632693664072452
refined_srvo_flaw_cnt_hd2_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd2_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5604223278121434
Validation AUC
0.4632693664072452
refined_srvo_flaw_cnt_hd3_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd3_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5441750048991195
Validation AUC
0.49808531149689034
refined_srvo_flaw_cnt_hd4_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd4_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4923022798339559
Validation AUC
0.5387509898577609










    

















    

















    

















    

















    






skip_tracks_hd0_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd0_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5344412104440361
Validation AUC
0.49435843734210894
skip_tracks_hd0_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd0_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5344412104440361
Validation AUC
0.49435843734210894
skip_tracks_hd1_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd1_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49226225401293244
Validation AUC
0.5245034868349056










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd5_fnc2_spc33400_aflaw_pad_17
refined_srvo_flaw_cnt_hd5_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5243893334105716
Validation AUC
0.5457977544649294










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd5_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd5_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5243893334105716
Validation AUC
0.5457977544649294










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd4_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd4_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4923022798339559
Validation AUC
0.5387509898577609










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd1_fnc2_spc33100_aflaw_pad_16
refined_srvo_flaw_cnt_hd1_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5385674626661617
Validation AUC
0.5366376437669723










    

















    

















    

















    

















    






skip_tracks_hd5_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd5_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5111682358505051
Validation AUC
0.4939467703040074
skip_tracks_hd3_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd3_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48480130061423554
Validation AUC
0.4969170021807148
skip_tracks_hd2_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd2_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4981338820768668
Validation AUC
0.4570521833729362
skip_tracks_hd5_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd5_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5111682358505051
Validation AUC
0.4939467703040074
skip_tracks_hd4_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd4_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.51212763786288
Validation AUC
0.49185545967360733
skip_tracks_hd4_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd4_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.51212763786288
Validation AUC
0.49185545967360733
skip_tracks_hd3_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd3_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48480130061423554
Validation AUC
0.4969170021807148
skip_tracks_hd1_fnc2_spc33400_aflaw_pad_17
skip_tracks_hd1_fnc2_spc33400_aflaw_pad_17 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49226225401293244
Validation AUC
0.5245034868349056










    

















    

















    

















    

















    






skip_tracks_hd2_fnc2_spc33100_aflaw_pad_16
skip_tracks_hd2_fnc2_spc33100_aflaw_pad_16 0.5784973471320926
5 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4981338820768668
Validation AUC
0.4570521833729362
refined_srvo_flaw_cnt_hd2_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd2_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5542343236394661
Validation AUC
0.48467783195939573
refined_srvo_flaw_cnt_hd1_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd1_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5540009102719967
Validation AUC
0.5056837878350376
skip_tracks_hd4_fnc2_spc30300_a_flawscan_18
skip_tracks_hd4_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48253044075202856
Validation AUC
0.4926008487346876
skip_tracks_hd5_fnc2_spc30300_a_flawscan_18
skip_tracks_hd5_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49972493905691756
Validation AUC
0.4935703493970958
skip_tracks_hd3_fnc2_spc30300_a_flawscan_18
skip_tracks_hd3_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4974429827019067
Validation AUC
0.48179883030876414
refined_srvo_flaw_cnt_hd0_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd0_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5370061296148085
Validation AUC
0.49701131134051446
refined_srvo_flaw_cnt_hd3_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd3_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5433461480507229
Validation AUC
0.4817499046563349
refined_srvo_flaw_cnt_hd4_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd4_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5513826836174158
Validation AUC
0.4884353745307601
skip_tracks_hd0_fnc2_spc30300_a_flawscan_18
skip_tracks_hd0_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5402660511025154
Validation AUC
0.5027163518671743
skip_tracks_hd1_fnc2_spc30300_a_flawscan_18
skip_tracks_hd1_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4962879810279494
Validation AUC
0.49675034340437035
skip_tracks_hd2_fnc2_spc30300_a_flawscan_18
skip_tracks_hd2_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5316055965484678
Validation AUC
0.4893631612281474
refined_srvo_flaw_cnt_hd5_fnc2_spc30300_a_flawscan_18
refined_srvo_flaw_cnt_hd5_fnc2_spc30300_a_flawscan_18 0.6615150844060498
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5395356386636191
Validation AUC
0.4990473325364374
refined_srvo_flaw_cnt_hd5_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd5_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5363124102577496
Validation AUC
0.5027976666427113
refined_srvo_flaw_cnt_hd1_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd1_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.553110356446942
Validation AUC
0.5064413610590462
refined_srvo_flaw_cnt_hd0_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd0_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.546557739178599
Validation AUC
0.4947907449424668
refined_srvo_flaw_cnt_hd4_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd4_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5468575758566998
Validation AUC
0.48978273198301453
refined_srvo_flaw_cnt_hd2_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd2_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.55327797030822
Validation AUC
0.48673930482479344
skip_tracks_hd5_fnc2_spc30200_a_flawscan_16
skip_tracks_hd5_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5044514736659599
Validation AUC
0.49137184785996013
skip_tracks_hd4_fnc2_spc30200_a_flawscan_16
skip_tracks_hd4_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48329588492684455
Validation AUC
0.49467598319367273
skip_tracks_hd1_fnc2_spc30200_a_flawscan_16
skip_tracks_hd1_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49753966382822895
Validation AUC
0.4842638665155646
skip_tracks_hd3_fnc2_spc30200_a_flawscan_16
skip_tracks_hd3_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5185326002940018
Validation AUC
0.4876342437249661
skip_tracks_hd2_fnc2_spc30200_a_flawscan_16
skip_tracks_hd2_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5356755734766029
Validation AUC
0.49408319421161156
skip_tracks_hd0_fnc2_spc30200_a_flawscan_16
skip_tracks_hd0_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5350667957950903
Validation AUC
0.495847596077485
refined_srvo_flaw_cnt_hd3_fnc2_spc30200_a_flawscan_16
refined_srvo_flaw_cnt_hd3_fnc2_spc30200_a_flawscan_16 0.661540208023553
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5436102919732346
Validation AUC
0.4856569377407465
refined_srvo_flaw_cnt_hd0_fnc2_spc30100_a_flawscan_9
refined_srvo_flaw_cnt_hd0_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5465455470003368
Validation AUC
0.4960994715815525
refined_srvo_flaw_cnt_hd1_fnc2_spc30100_a_flawscan_9
refined_srvo_flaw_cnt_hd1_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5529320252788152
Validation AUC
0.5064229002121633
refined_srvo_flaw_cnt_hd3_fnc2_spc30100_a_flawscan_9
refined_srvo_flaw_cnt_hd3_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5441866628090293
Validation AUC
0.48565325047250657
refined_srvo_flaw_cnt_hd2_fnc2_spc30100_a_flawscan_9
refined_srvo_flaw_cnt_hd2_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5525151595518961
Validation AUC
0.48997515893045596
skip_tracks_hd0_fnc2_spc30100_a_flawscan_9
skip_tracks_hd0_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5356611473191951
Validation AUC
0.4972636305252747
skip_tracks_hd1_fnc2_spc30100_a_flawscan_9
skip_tracks_hd1_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed

15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5374632822577745
Validation AUC
0.5022745906209024
skip_tracks_hd5_fnc2_spc30100_a_flawscan_9
skip_tracks_hd5_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5039278054061522
Validation AUC
0.4918386614954762
skip_tracks_hd4_fnc2_spc30100_a_flawscan_9
skip_tracks_hd4_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4834171982714665
Validation AUC
0.49476401224005384
skip_tracks_hd2_fnc2_spc30100_a_flawscan_9
skip_tracks_hd2_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5346148461253206
Validation AUC
0.4971231794036699
skip_tracks_hd3_fnc2_spc30100_a_flawscan_9
skip_tracks_hd3_fnc2_spc30100_a_flawscan_9 0.6616011560586069
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5170676700574619
Validation AUC
0.4925059866001308
refined_srvo_flaw_cnt_hd4_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd4_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5186045435420468
Validation AUC
0.4802860934274796
skip_tracks_hd4_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd4_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4867535049179953
Validation AUC
0.4989530726893895
refined_srvo_flaw_cnt_hd1_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd1_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5628754624959739
Validation AUC
0.501066901358476
skip_tracks_hd1_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd1_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5220381148260713
Validation AUC
0.5073166824130758
skip_tracks_hd0_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd0_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5345394193719525
Validation AUC
0.4950294270518262
skip_tracks_hd5_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd5_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5229274228153338
Validation AUC
0.49944973310573143
skip_tracks_hd3_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd3_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5045546994008208
Validation AUC
0.494771260856613
skip_tracks_hd2_fnc2_spc32700_aflaw_pad_15
skip_tracks_hd2_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5218328195132594
Validation AUC
0.49009198462650794
refined_srvo_flaw_cnt_hd5_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd5_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5883162375157935
Validation AUC
0.5300719421705492










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd0_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd0_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5550451303549222
Validation AUC
0.4849713646603177
refined_srvo_flaw_cnt_hd2_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd2_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.521037939603416
Validation AUC
0.48104155207033056
refined_srvo_flaw_cnt_hd3_fnc2_spc32700_aflaw_pad_15
refined_srvo_flaw_cnt_hd3_fnc2_spc32700_aflaw_pad_15 0.7715058165827041
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5410013199932703
Validation AUC
0.5069961867785949
refined_srvo_flaw_cnt_hd5_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd5_fnc2_spc32400_aflaw_pad_14 0.7718677827756201
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.59242266932476
Validation AUC
0.530340706976814










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd4_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd4_fnc2_spc32400_aflaw_pad_14 0.7718677827756201
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5189043973689861
Validation AUC
0.481679591080396
skip_tracks_hd4_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd4_fnc2_spc32400_aflaw_pad_14 0.7718677827756201
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48640519608222427
Validation AUC
0.4980513847994663
skip_tracks_hd5_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd5_fnc2_spc32400_aflaw_pad_14 0.7718677827756201
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5247962310782274
Validation AUC
0.5054283428989333
refined_srvo_flaw_cnt_hd4_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd4_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5184179358648605
Validation AUC
0.481072514463901
skip_tracks_hd3_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd3_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5070129531164951
Validation AUC
0.501627802807328
refined_srvo_flaw_cnt_hd3_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd3_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5438273670942301
Validation AUC
0.5104270573467682
refined_srvo_flaw_cnt_hd2_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd2_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5225457754882782
Validation AUC
0.48147835565046687
refined_srvo_flaw_cnt_hd2_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd2_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5218213822668897
Validation AUC
0.4799869953669242
skip_tracks_hd2_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd2_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5226573081727045
Validation AUC
0.4894357248614573
skip_tracks_hd0_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd0_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5400476418201318
Validation AUC
0.4990241511484012
skip_tracks_hd1_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd1_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5236503016914913
Validation AUC
0.5056364768212698
skip_tracks_hd0_fnc2_spc32400_aflaw_pad_14
skip_tracks_hd0_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5357598476712294
Validation AUC
0.4934504292533514
skip_tracks_hd2_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd2_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5255820408702129
Validation AUC
0.49400738734761895
refined_srvo_flaw_cnt_hd5_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd5_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5924547497993171
Validation AUC
0.5296524732645816










    

















    

















    

















    

















    






skip_tracks_hd3_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd3_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5078061005243554
Validation AUC
0.499719668665874
refined_srvo_flaw_cnt_hd3_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd3_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5439690769850448
Validation AUC
0.5108469740575461
skip_tracks_hd1_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd1_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5227722627455214
Validation AUC
0.5015508470141672
refined_srvo_flaw_cnt_hd1_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd1_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5640184805068393
Validation AUC
0.5006068584273005
refined_srvo_flaw_cnt_hd0_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd0_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5532214423890447
Validation AUC
0.484502137567043
refined_srvo_flaw_cnt_hd1_fnc2_spc32100_aflaw_pad_13
refined_srvo_flaw_cnt_hd1_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5630963272542436
Validation AUC
0.5009237062764174
skip_tracks_hd5_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd5_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5271644636349135
Validation AUC
0.5061889968544732
skip_tracks_hd4_fnc2_spc32100_aflaw_pad_13
skip_tracks_hd4_fnc2_spc32100_aflaw_pad_13 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4845135965717806
Validation AUC
0.49846290818973793
refined_srvo_flaw_cnt_hd0_fnc2_spc32400_aflaw_pad_14
refined_srvo_flaw_cnt_hd0_fnc2_spc32400_aflaw_pad_14 0.7718682480277961
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5541185186473573
Validation AUC
0.4837049346002494
skip_tracks_hd5_fnc2_spc1_aflaw_pad_12
skip_tracks_hd5_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5271111210769721
Validation AUC
0.5061534440026466
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5630410984405133
Validation AUC
0.5008939154532082
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.55316807833473
Validation AUC
0.4844762252164646
skip_tracks_hd4_fnc2_spc1_aflaw_pad_12
skip_tracks_hd4_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.4845640836135541
Validation AUC
0.49849461553339736
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.54379276882934
Validation AUC
0.5103991884304828
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.522518472919219
Validation AUC
0.4814595234317738
skip_tracks_hd0_fnc2_spc1_aflaw_pad_12
skip_tracks_hd0_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5399977373261968
Validation AUC
0.4989976498480447
skip_tracks_hd1_fnc2_spc1_aflaw_pad_12
skip_tracks_hd1_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5227213531825363
Validation AUC
0.5015142419631867
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.592391946577516
Validation AUC
0.5296154808465642










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_12
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.518443593578247
Validation AUC
0.4810096619503933
skip_tracks_hd2_fnc2_spc1_aflaw_pad_12
skip_tracks_hd2_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5255481329245246
Validation AUC
0.4939805001005707
skip_tracks_hd3_fnc2_spc1_aflaw_pad_12
skip_tracks_hd3_fnc2_spc1_aflaw_pad_12 0.7718729005495558
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5077701204836287
Validation AUC
0.4996887899077572
skip_tracks_hd4_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd4_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.48056323491719394
Validation AUC
0.49448862981084607
skip_tracks_hd2_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd2_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5245763146417053
Validation AUC
0.5007664249821724
skip_tracks_hd0_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd0_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5457066524583323
Validation AUC
0.5124609210018057
refined_srvo_flaw_cnt_hd0_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd0_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5579257421489476
Validation AUC
0.48819419733217945
refined_srvo_flaw_cnt_hd2_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd2_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5173719426676969
Validation AUC
0.4780178254504834
refined_srvo_flaw_cnt_hd4_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd4_fnc2_spc30600_aflaw_pad_10 0.772346992516884
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5166942286285647
Validation AUC
0.48124538884221996
refined_srvo_flaw_cnt_hd5_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd5_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5986827627354063
Validation AUC
0.5465976553385162










    

















    

















    

















    

















    






skip_tracks_hd3_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd3_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5099073150829675
Validation AUC
0.4861371190825619
refined_srvo_flaw_cnt_hd1_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd1_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5737018187384407
Validation AUC
0.49739667431825063
skip_tracks_hd5_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd5_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5290478334861127
Validation AUC
0.5108256490639965
refined_srvo_flaw_cnt_hd3_fnc2_spc30600_aflaw_pad_10
refined_srvo_flaw_cnt_hd3_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5450211780821835
Validation AUC
0.5125613897386859
skip_tracks_hd1_fnc2_spc30600_aflaw_pad_10
skip_tracks_hd1_fnc2_spc30600_aflaw_pad_10 0.77234745776906
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5208948426296184
Validation AUC
0.5002510813716227
refined_srvo_flaw_cnt_hd0_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd0_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49705603258610953
Validation AUC
0.472903722737411
refined_srvo_flaw_cnt_hd2_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd2_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5163853429360223
Validation AUC
0.4980415805607566
skip_tracks_hd2_fnc2_spc1_zap_14
skip_tracks_hd2_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5896986414074318
Validation AUC
0.5119407540731472
skip_tracks_hd0_fnc2_spc1_zap_14
skip_tracks_hd0_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5255842560394961
Validation AUC
0.4988479576068778
skip_tracks_hd4_fnc2_spc1_zap_14
skip_tracks_hd4_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5966895778971303
Validation AUC
0.5068298047665185
refined_srvo_flaw_cnt_hd4_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd4_fnc2_spc1_zap_14 0.7825513684927504
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5208690298674638
Validation AUC
0.5182232087443601
refined_srvo_flaw_cnt_hd3_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd3_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.49428467396966524
Validation AUC
0.5013946060161408
skip_tracks_hd3_fnc2_spc1_zap_14
skip_tracks_hd3_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5557164285446432
Validation AUC
0.5019458860357056
refined_srvo_flaw_cnt_hd5_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd5_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5057616653387338
Validation AUC
0.4976693587674248
skip_tracks_hd5_fnc2_spc1_zap_14
skip_tracks_hd5_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5910817758036451
Validation AUC
0.4905278180484226
skip_tracks_hd1_fnc2_spc1_zap_14
skip_tracks_hd1_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5646900424980643
Validation AUC
0.4994559589141599
refined_srvo_flaw_cnt_hd1_fnc2_spc1_zap_14
refined_srvo_flaw_cnt_hd1_fnc2_spc1_zap_14 0.7825518337449264
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5138024005037016
Validation AUC
0.510562647101981
skip_tracks_hd3_fnc2_spc1_aflaw_pad_11
skip_tracks_hd3_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6052852932268068
Validation AUC
0.49749381766527234
skip_tracks_hd2_fnc2_spc1_aflaw_pad_11
skip_tracks_hd2_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6273704310891534
Validation AUC
0.4990752095793506
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6203698650462284
Validation AUC
0.5048855958502427
skip_tracks_hd5_fnc2_spc1_aflaw_pad_11
skip_tracks_hd5_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6187482297598452
Validation AUC
0.504681656877444
skip_tracks_hd4_fnc2_spc1_aflaw_pad_11
skip_tracks_hd4_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6284332096643446
Validation AUC
0.507716318635205
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6125680531005274
Validation AUC
0.5335184440713425










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.614363285721432
Validation AUC
0.5228681214490254










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6155020508342857
Validation AUC
0.5182645404655627
skip_tracks_hd0_fnc2_spc1_aflaw_pad_11
skip_tracks_hd0_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6005481072360644
Validation AUC
0.5108610854646937
skip_tracks_hd1_fnc2_spc1_aflaw_pad_11
skip_tracks_hd1_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5992481126965286
Validation AUC
0.49513793196239997
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6538785745224837
Validation AUC
0.5249864552955132










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_11
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_11 0.9435690983226729
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6342941998963666
Validation AUC
0.5052569373537581
refined_srvo_flaw_cnt_hd2_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd2_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5831316894735846
Validation AUC
0.5192875634099136
refined_srvo_flaw_cnt_hd0_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd0_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5797187254977406
Validation AUC
0.5230586177857821










    

















    

















    

















    

















    






skip_tracks_hd0_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd0_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5221725509241829
Validation AUC
0.5144449190140064
skip_tracks_hd4_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd4_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5950226578843325
Validation AUC
0.5115649545245519
refined_srvo_flaw_cnt_hd4_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd4_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6238726025070629
Validation AUC
0.5046064085280995
skip_tracks_hd2_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd2_fnc2_spc30310_aflaw_pad_9 0.9438622071935431
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5718198573937454
Validation AUC
0.5014624313970957
skip_tracks_hd1_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd1_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5322299356615897
Validation AUC
0.4964456774804838
skip_tracks_hd5_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd5_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.551225822487375
Validation AUC
0.5073837641110566
refined_srvo_flaw_cnt_hd1_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd1_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5862163807748318
Validation AUC
0.5047695535468765
refined_srvo_flaw_cnt_hd3_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd3_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5771458092153473
Validation AUC
0.5354210731470229










    

















    

















    

















    

















    






skip_tracks_hd3_fnc2_spc30310_aflaw_pad_9
skip_tracks_hd3_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5477006802828172
Validation AUC
0.49172326335809574
refined_srvo_flaw_cnt_hd5_fnc2_spc30310_aflaw_pad_9
refined_srvo_flaw_cnt_hd5_fnc2_spc30310_aflaw_pad_9 0.943862672445719
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6359163292698116
Validation AUC
0.5239680577290379










    

















    

















    

















    

















    






skip_tracks_hd2_fnc2_spc1_aflaw_pad_7
skip_tracks_hd2_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5718512964639679
Validation AUC
0.5015041689025115
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5831253021324182
Validation AUC
0.5192922721822452
skip_tracks_hd0_fnc2_spc1_aflaw_pad_7
skip_tracks_hd0_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5222111730236767
Validation AUC
0.5142946742823168
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6238583075197048
Validation AUC
0.5044292359591012
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5795381509200122
Validation AUC
0.5230666711337794










    

















    

















    

















    

















    






skip_tracks_hd4_fnc2_spc1_aflaw_pad_7
skip_tracks_hd4_fnc2_spc1_aflaw_pad_7 0.9438673249674788
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5950381486783798
Validation AUC
0.5116003904820868
skip_tracks_hd1_fnc2_spc1_aflaw_pad_7
skip_tracks_hd1_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5322694089385156
Validation AUC
0.49622010021533536
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6359212915947279
Validation AUC
0.5239748650616219










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.586225544148521
Validation AUC
0.5047763011778581
skip_tracks_hd5_fnc2_spc1_aflaw_pad_7
skip_tracks_hd5_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5512562726325391
Validation AUC
0.5074326048638698
skip_tracks_hd3_fnc2_spc1_aflaw_pad_7
skip_tracks_hd3_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5477349856340565
Validation AUC
0.49152282184606133
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_7
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_7 0.9438677902196548
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5771536920385529
Validation AUC
0.5352516864263073










    

















    

















    

















    

















    






refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd2_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5890997062607198
Validation AUC
0.5199997959129459
skip_tracks_hd0_fnc2_spc1_aflaw_pad_4
skip_tracks_hd0_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5214688428419335
Validation AUC
0.5159631332087508
skip_tracks_hd2_fnc2_spc1_aflaw_pad_4
skip_tracks_hd2_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5729187359589027
Validation AUC
0.4997871766911988
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd4_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6249966237782327
Validation AUC
0.5081700792283197
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd0_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5795852282443013
Validation AUC
0.5220470974196935










    

















    

















    

















    

















    






skip_tracks_hd4_fnc2_spc1_aflaw_pad_4
skip_tracks_hd4_fnc2_spc1_aflaw_pad_4 0.9439338560286447
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5888677304450097
Validation AUC
0.5107358858906791
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd5_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.6307790320180574
Validation AUC
0.5130163548614761
skip_tracks_hd5_fnc2_spc1_aflaw_pad_4
skip_tracks_hd5_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5464790400524444
Validation AUC
0.5064148240337392
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd1_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5869427323968028
Validation AUC
0.5065514039012744
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_4
refined_srvo_flaw_cnt_hd3_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5806837498407144
Validation AUC
0.5278726553817313










    

















    

















    

















    

















    






skip_tracks_hd3_fnc2_spc1_aflaw_pad_4
skip_tracks_hd3_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5482853586297707
Validation AUC
0.49079608575545586
skip_tracks_hd1_fnc2_spc1_aflaw_pad_4
skip_tracks_hd1_fnc2_spc1_aflaw_pad_4 0.9439343212808207
5 bins processed
15 bins processed
glm Model Build progress: |███████████████████████████████████████████████| 100%
Training AUC
0.5314723137047478
Validation AUC
0.49538462975234365